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So normally when you hear these surveys on 


television, they say, you know, 55 percent for candidate A, 





45 percent for candidate B, and then they give a plus or 
minus. Okay. That plus or minus is actually two times the 
standard deviation -- roughly two times the standard error. 
So that's that sort of the precision with which I'm -- I'm 
estimating this parameter. In the case of the political 


candidate, it's, you know, the votes they're going to get 





or the people favoring them or whatever. In my estimates, 


it's the estimate of a particular partworth. 


Now, just, again, for the record, kind of mixing a 





little bit of philosophy here between frequentist and 








Bayesian statistics, in terms of the Bayesian, it's the 





posterior Bayesian confidence interval; they've got fancy 
words, but it's usually best to think of it as the 
confidence interval. So for every one of the parameters in 


my population, I can give you both the estimate and in 





Exhibit -- I thought it was here. 
MR. ILLOVSKY: Are you looking for 


12, K in your report? 





THE WITNESS: Yeah. T can't find 12. 











MR. ILLOVSKY: Use that. 





THE WITNESS: Okay. 














Bs Exhibit 12, which is K, you can see the standard 





error of the market level mean. 
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So to interpret this, they say table Kl. We have 
the first feature, which is "Reliable Touch, Auto-Switch (1 
to 2 Fingers, Rubberband, Tap and Re-center the Zoom," the 


average market level mean is 64.5, and we also have medians 





in there, and I'll explain the difference in a moment, and 
the standard error is 2.1. So you can see it's, you know, 
that's pretty good precision. 

0. Does this mean that the willingness to pay for any 
given individual is measured with high precision? 

A. Oh, no. Absolutely not. 

O'. Okay. 

A. You know, and I actually give an example of 
flipping coins to try and motivate this concept. You can 


have high precision at the population level, but not high 


precision at the level of each and every individual. 





Q. Okay. Let's go to page 48 of Exhibit 1. Okay. 
So do you see -—- do you see table 3A in your report? 
A. Yes, I do. 


Ole And then if you flip the page, you'll see table 





A. Yes, I do. 

0’. Okay. So these are the -- here's the -- the means 
and the standard deviations; right? 

A. No. Let's be clear what we have here. Okay. 


There is an estimate of the mean and the market 
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heterogeneity, which is the distribution, standard 
distribution, of these partworths across the population. 

Q. This is the population of the respondents, or is 
this the population of -- of the 10,000? 

A. I -- I have -- I mean I think you're confusing 
draw as from a posterior distribution with the population. 

Q. What are you -- okay. So the pop -- what do you 
mean by the population? 

A. Okay. So I have four hundred and -- this is 
smartphones -- 455 respondents. 

0. Uh-huh. 

A. Okay. And what I'm doing is I'm estimating for 
the target population, now, the mean level of the partworth 
and how much it varies. So think of it as you may have a 


different partworth than I do, and Dr. Sukumar may have yet 





another partworth, and Eugene may have a different 
partworth, et cetera. I can't -- I can't actually -- I can 
get an estimate of each one of those partworths, but -- but 
not with a lot of high precision. But I can estimate how 
these vary across the population. And I can do that with 
high precision. 


So it's kind of like saying if I drive in the 





Southeast Expressway, it's going to take me 20 minutes plus 


or minus 10 minutes. I can get a pretty good estimate that 


on average it takes me 20 minutes, of course that's 
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A. Yes. You shouldn't -- you should not use ACBC if 
you have less than five attributes. That's what it means. 
OQ: It doesn't -- it doesn't -- it doesn't recommend 
using -- so the way you read this is not a recommendation 


that you use ACBC when you have more than five attributes; 





you don't read it that way? 
A. Did you read the technical manual? 
Q. I did not. Did you? 
A. Yes, I did. 


Ow And what does it say? 





A. Okay. I'm quite happy to explain ACBC to you. 
Q. No, that's not -- that's not the question. You 
know, I've been patient today with -- with the responses 


that are really nonresponsive to a lot of the questions. 





But we're running out of time, and I am just asking you is 


your interpretation of a printout from Sawtooth's website 





where it says "When to Use ACBC" and it indicates "Five or 
more attributes," it is -- it's your understanding that 


ACBC should not be used when you have fewer than five 





attributes; is that your understanding? 


MR. ILLOVSKY: Wait. So hold on. 





I've got to object to the preface. The 
answers have been perfectly responsive when 
the questions have been comprehensible, 


which has not been a large percentage of 
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the time. So object to the preface, object 
to the question. 
Go ahead. 
A. Can you ask -- re-ask the question? 


Q. Let's move on. Look at the -- look at the last 





paragraph on page 1 of what's been marked as Exhibit 20. 
It says, "In addition to the standard partworth utilities 
that are useful for segmentation and market simulation, we 


captured the specific 'must-have' and 'unacceptable' rules 








that respondents expressed during the screening process." 
You're familiar with that term "must-have"; right? 

A. Well, if you had read the technical manual, you'll 
see that they're pretty widely quoting many of my papers. 
So, yes, I am definitely familiar with this. 

Q. Okay. 

A. And I'd like to also point out that we did these 
tests on our data. And what these refer to is 
lexicography. And they're -- in many cases consumers are 
lexicographic when there are a lot of features or when the 
choice task is speeded up or other things. And we did do 
lexicography tests in our data, which are entirely doable 
with all the information we gave you. 

And I can tell you that out of seven features 


times roughly, you know, 800 respondents, it's like 5600 


possible tasks, exactly one was lexicographic, and it was 
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lexicographic on price. So we did do the test as to 


whether or not we should have must-have features in there, 





which can be done after the fact, and it fully essentially 


confirms that there is no lexicography; because there's no 





lexicography, we don't need ACBC. 

Now, of course, I only did this after I had the 
data. So I made a judgment up front, again, from my 
experience, from also the qualitative interviews, that we 
probably did not need to worry about lexicography in this 
particular study. And that turned out to be correct. So 
to have one out of like 5600, that can almost even be by 
chance. 

Q. Why didn't you -- why didn't you mention in your 
report that you tested for must-have features? 

A. Oh, I -- I only did this test after I read Dr. 
Sukumar's results, because I didn't -- I mean we did not 


have any indications that there should be any lexicography. 


Also, you know, I know Sawtooth says "five or more" here, 


but you're really -- it's going to be very rare that you 
have lexicography for as little as five attributes. It's 


going to be upwards of 20 or so before you start having it. 





I did not expect it. But given that he raised it, Dr. 
Sukumar raised it, and given that I could test it with the 


data that you had been given, I tested it. 





Q. Part of your opinion is -—- is the value placed on 
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the '915, the '161, and the '381 patents combined. Are you 
able to break out the individual value of those patents? 

A. Okay. Let me just add that you've been given all 
the code that we ran for the lexicographic tests. 

So can you -- can you re-ask that question? 

0 Part of your opinion is the value placed on the 
"915, the '161, and the '381 patents combined. Are you 
able to break out the individual value of those patents to 
Samsung consumers? 

A. Okay. So -- 

MR. ILLOVSKY: Objection to form. 
Take a look at the report again. 
MR. GALVIN: I withdraw the question. 


Let's take a break, please. 

















THE VIDEOGRAPHER: Going off the 


record. The time is 5:09. 
Recess.) 
Exhibit 21, DVD labeled "Hauser 


Data Files," marked.) 








EF VIDEOGRAPHER: We're back on the 














record. The time is 5:20. 


BY MR. GALVIN: 





Q. Dr. Hauser, for each of your respondents, how many 
records are there? 


A. I am not sure I understand the —-- 
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at the willingness to pay estimates at some point? On an 
individual level, did you examine all -- 
A. I, in fact, not only didn't I do it, but I -- I 


gave the example with the head -- with the coin-flipping 





example, and, again, at least nine places in the report, it 
was in two of the footnotes, I'm very explicit as to why 
that would -- that is not what one should do, and that that 


would be a naive thing to do. I've got enough experience 





with hierarchical Bayes to know these issues are in there. 





And, you know, when I read Dr. Sukumar's results, 
and he's getting numbers like he modified the code, and he 


got numbers that are absurd. And you should look at those 





and say, well, gee, they are absurd. So why are they 





absurd? Well, because the code was modified. 
Q. Well, did you get results that were absurd? 


A. No. I did the calculations correctly. 





Q. But you didn't look on an individual level at 
the -- at the calculations, did you? 
MR. ILLOVSKY: Objection to form. 
A. You know, I -- I wrote a set of procedures; I 


wrote the set of procedures that are correct. We're now 


talking about 10,000 draws for 800 consumers times -—- four 


times -- times 28 partworths. So what is that? Millions, 
billions? No, I didn't look at a billion different 


numbers. I looked at the appropriate output of 
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calculations based on whatever it is, a billion different 
numbers. 

QO. Did you look at the median of those calculations? 

A. I looked at -- I did the median appropriately. 

OQ. So what was the -- what was the median? 

A. The median, as described, it's -- we can look it 
up, you know. 

QO: Do you remember? 

A. Is it a memory test? 


No. It's -- I'm asking you if you remember or 





Do I remember the exact number? 
Uh-huh. 


The exact number's in my report. We can look it 


QO: Okay. Let's go -- let's go there. 

A. (Pause.) Well, it's basically footnote 72, 73, 
and you'll note that in 72 it says, "For each of these 
samples, I computed a median willingness to pay for the 
market. I then computed an overall market level 


willingness to pay by taking the median of the 10,000 


sample medians," okay? And then I cautioned, "As explained 


in the earlier coin-flipping examples, reporting a 


willingness to pay for an individual respondent would not 





be sufficiently precise; however, the overall market level 
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willingness to pay is sufficiently precise." So I 
definitely cautioned that. 

Now, in -- in paragraph 73, doing those median 
calculations, so doing the medians within the sampler, 
okay, so in the -- getting the posterior distribution of 
the medians, I then, having gotten that posterior 
distribution of the medians, we can now say something like 


the willingness to pay estimates at a base price of 199, 


customers would be willing to pay $40 more for a smartphone 


that has the functionality associated with patent '915. 
And then it goes on from there. 

And you'll note that how this, then, is used is up 
in paragraph 104, and it says, "The median willing -- 
consumer willingness to pay calculation leads price premium 
estimates that are similar to what I estimate using the 
market simulation." So I'm using it for a convergent 
check. 

Q. So if we look at -- if we look at any one 
respondent's draws, that doesn't really -- that doesn't 
really tell us their willingness to pay for -—- for any of 
the features? 

A. Again, let's go back to the coin-flipping example. 
If I end up with two heads, my estimate, you know, for that 
particular respondent, you know, in fact, my maximum 


likelihood estimate is 100 percent. You know, so I'm not 
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going to be very precise. 

Q. Okay. 

A. So in -- when I look at any individual, I have 48 
constraints, plus I have a number of monotonicity 
constraints, and I think if we count up the number of 
features, it's something like 7 times 3. Not completely, 
because there's -- not everything's monotone. So, you 
know, I basically have, what, maybe 60 constraints for 20, 
21 features. I can't expect that to be precise. However, 
when I get up to 20,000 constraints, which is what I have 
for the population, I can expect that to be fairly precise. 

So, no, you should not look at it at the 
individual level, and as in the documents that you don't 
like to refer to, you say, well, some of these appear to be 
negative, again, just doing the arithmetic calculation, 
almost none of those are sufficiently precise to -- to say 


they're negative. 





What we can say is that for roughly -- and also 
they're conflated. We can look at it the other way around 


and say that for 94 percent of the people, they have 








positive partworths for one of the patents. But I don't 


want to conflate it either way. 


The key thing is none of those are significant -- 


I think one of those are significant out of all those 





tests. And there are people who -- who don't value. I 
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